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DYNAMIC  REPAIR  ALLOCATION  FOR  A  K  OUT  OP  N  SYSTEM 
MAINTAINED  BY  DISTINGUISHABLE  REPAIRMEN. 

by 


Michael  N.  Katehakis  and  Coatis  Nelolidakis 

Technical  University  of  Crete  Technical  University  of  Crete 

and  Coluabia  University 


ABSTRACT 

We  consider  a  K  out  of  N  system  maintained  by  R  repairmen, 
where  the  lifetime  of  the  ifcb  component  is  an  exponentially  distributed 
random  variable  with  parameter  (if  .  Repairmen  are  distinguishable,  and 
the  time  it  takes  the  r^  repairman  to  repair  a  failed  component  is  an 
exponentially  distributed  random  variable  with  parameter  Xr  .  Repaired 
components  are  as  good  as  new  and  preemptions  are  allowed.  We  show 
that  the  policy  which  assigns  the  faster  repairmen  to  the  most  reliable 
components  is  optimal  with  respect  to  several  optimality  criteria. 

The  approach  we  take  in  establishing  stochastic  optimality  with 
respect  to  the  number  of  functioning  components  is  of  wide  applicability 
to  different  classes  of  stochastic  optimisation  problems. 


1.  Introduction.  Consider  a  system  chat  consists  of  N  components.  The 
system  is  functioning  when  at  least  K  out  of  its  N  components  are 
operating.  Components  may  fail,  their  lifetimes  being  exponentially  distributed 
random  variables.  Failures  occur  independently  and  a  component  may  fail 
even  when  the  system  is  not  functioning.  The  rate  of  failure  of  component  i 
is  denoted  by  m  ,  i  =  1,...,N  .  The  system  is  maintained  by  R  repairmen. 
At  most  one  repairman  can  be  assigned  to  a  failed  component  and  a  repairman 
may  switch  from  one  failed  component  to  another  instantaneously.  The  time 
required  by  the  r^  repairman  to  complete  the  repair  of  any  failed  component 
is  considered  to  be  an  exponentially  distributed  random  variable  with 


*Thia  research  was  partially  supported  by  the  N3F  under  Grant  NO. 
BCS-85-07671  and  the  APOSR  under  contract  87-0072. 
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parameter  Xr  ,  r  =  1,...,R  .  Repaired  components  are  as  good  as  new. 

We  show  that  the  policy  under  which  the  fastest  repairman  (i.e.,  the  one 
with  the  largest  repair  rate)  is  assigned  to  the  most  reliable  failed  component 
(i.e.,  the  one  with  the  smallest  failure  rate)  the  next  to  the  fastest  repairman 
is  assigned  to  the  next  to  the  most  reliable  failed  component,  etc.  (FR-MRC 
policy),  possesses  the  following  optimality  properties. 

It  maximizes  stochastically  the  number  of  working  components  of  the  system  at 
any  time  instant  t  .  Hence,  it  maximizes  both  the  expected  discounted  system 
operation  time  for  all  discount  rates  0  ,  f)  *  0  and  the  average  system 
operation  time.  Furthermore,  it  maximizes  stochastically  the  time  the  system 
spends  in  functioning  states  before  a  failure  occurs,  and  it  minimizes 
stochastically  the  time  the  system  is  down  before  it  starts  operating  again. 

This  problem  has  been  studied  for  the  case  in  which  R  =  1  in  Derman 
Lie  barman  and  Ross  (1980)  ,  where  it  is  shown  that  the  pertinent  policy 
stochastically  maximizes  the  operation  time  of  the  system  during  any  time 
interval.  The  case  in  which  R  =  1  ,  failure  and  repair  times  are 
exponentially  distributed  and  the  repair  rates  depend  on  the  components  has 
been  considered  in  Katehakis  and  Derman  (1984)  with  respect  to  the  average 
system  operation  time,  and  in  Katehakis  and  Melolidakis  (1987),  with  respect  to 
the  stochastic  optimality  of  the  system  nonfunctioning  time.  See  also  Smith 
(1978). 

2.  Problem  formulation-  Under  the  as susp t ions  made,  at  any  time  the  status 
of  all  components  is  given  by  a  vector  x  =(Xj, ...,Xjj)  with  Xi  =  1  or  0 
according  to  whether  the  component  is  functioning  or  failed,  lhus,  the 

set  of  all  possible  states  is  S  =  {0,1}  .  For  any  state  x  e  S  ,  we  define 

states  (ij^,x)  ■  (x^ , . . . ,  x^^ji  &  *  ^k^l  *  *  *  *  *  >  6  ■■  0 ,  1  ,  k  ~  1 , . . ,  N  ,  and  we 

denote  the  sets  of  failed  and  functioning  components  by  C0(x)  and  Ct(x)  , 
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i.e.,  Co(x)  =  {i  I  =  0}  ,  Ci(x)  =  {i  I  =  1}  respectively. 

The  cardinality  of  a  set  A  is  denoted  by  I A  l  .  For  notational  simplicity  we 
define  ixl  -  ICt(x)l  .  Let  So  s  {x  :  lx>  z  K)  denote  the  set  of  failed 
states  and  Si  ={x  :  ixl  l  K}  denote  the  set  of  functioning  states  of  the 
system. 

We  number  the  components  according  to  their  failure  rates  ,  i.e.f 
j  •  i  if  and  only  if  Hj  *  Fj  ,  and  the  repairmen  reversely  to  their  repair 
rates,  i.e.,  r  •  s  if  and  only  if  Xr  *  X8  . 

Let  then  q(x)  be  the  qth  failed  component  at  state  x  and  let  aq(x) 
be  the  order  of  q(x)  .  Let  also  X(x)  =  Xq  . 

The  set  of  repairmen  is  denoted  by  R  and  IRI  =  R  .  Let  R(x)  denote 
the  maximum  number  of  components  that  can  be  under  repair  when  the  system 
is  in  state  x  ,  i.e., 

R(x)  =  min  (R,  lC0(x)l)  . 

Let  W(x)  be  the  set  of  all  possible  choices  of  components  on  which  one 
may  decide  to  assign  repairmen  when  the  system  is  in  state  x  ,  i.e., 

W(x)  =  {  B  :  B  c  C0(x)  ,  I B l  <  R(x)  }  . 

For  B  €  W(x)  ,  let  A(B,x)  be  the  set  of  possible  choices  of  repairmen  one 
may  decide  to  use  if  he  chooses  B  ,  i.e., 

A(B»x)  =  {  C  :  C  «  R  ,  iCt  =  IBI  }  . 

An  assignment  of  repairmen  C  e  A(B,x)  to  components  B  e  W(x)  is  an 
1-1  and  onto  mapping  from  B  to  C  .  Denote  by  ♦<B,C)  the  set  of  these 
mappings  and  let  A(x)  represent  the  available  actions  at  state  x  ,  i.e., 

A(x)  =  {  :  B  e  W(x),  C  e  A(B,x),  f  e  *(B,C)  } 

The  problem  of  the  stochastic  maximisation  of  the  number  of  functioning 
components  at  any  time  instant  t  can  be  formulated  as  a  family  of  Markovian 
decision  problems  in  the  following  way. 
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Since  the  state  space  is  finite  we  can  use  the  device  of  uniformization 
(see  Lippman  (1975)  and  references  given  there)  which  essentially  means  that 
we  can  consider  (dummy)  transitions  back  to  the  same  state  at  such  a  rate 
that  the  sojourn  times  Xj  ,  X2  ,  ...  of  the  processes  are  independent 

exponential  random  variables  with  a  common  rate  v  .  The  constant  v  can 

be  chosen  as  any  number  greater  than  or  equal  to  the  sum  of  the  transition 
rates.  The  sum  Sn  =  Xj  +  X2  +•••+  Xn  represents  the  time  of  the  n^h 
transition  of  the  system.  Let  nt  =  sup  (n:  Sn  *  t)  ,  i.e.,  nt  is  is  the 
record  of  the  last  transition  that  occured  up  to  time  t  .  Because  of  the 
uniformization,  the  distributions  of  Sn  and  nt  are  independent  of  the 
particular  policy  we  follow.  Given  a  policy  n  we  define  the  random  variable 
Nir(t»x)  ,  where  N^(t;x)  =  0,...,  N  ,  represents  the  number  of  working 

components  at  time  t  if  the  state  at  time  0  was  x  .  Let  ttq  denote  the 

FIHIKC  policy. 

Our  aim  ia  to  show  that 

p(  Nir^t.-x)  ‘  k  )  ‘  P(  Nffft.-x)  *  k  )  for  all  policies  n  ,  0  «  k  *  N  (1)  . 

Let  Nff(n;x)  ,  n  *  1  ,  be  the  number  of  working  components  after  the  n^ 
transition  if  the  state  at  time  0  was  x  .  Then,  Nn(t;x)  =  Nn(nt;x)  and 
therefore,  since 

P(  »ir(nt;*)  *  k  )  =  £®=1P(  N*(n;x)  *k)P(nt  =  n)  ,  0  *  k  <  N  . 

it  ia  sufficient  to  show  that 

p(  l*n0(n;*)  *  k  )  *  P(  %(n;x)  *  k  )  for  all  policies  tt  ,  all  a  *  1 

After  uniformization,  the  relevant  family  of  Markovian  decision  problems  will  be 
the  following. 
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For  each  n  ,  n  *  1  ,  and  for  each  k  ,  0  *  k  *  N  consider  the 

problem  nn,k  which  is  specified  by  the  following  elements. 

1.  State  space:  the  set  {(x;m)  :  x  £  S  ,  m  =  0,  1,...,  n  }. 

2.  Action  sets:  the  sets  A(x;m)  =  A(x). 

3.  System  dynamics:  when  the  system  is  in  state  (x;m)  and  action 

a  =  (B,C,$)  e  A(x)  is  chosen  ,  the  following  transitions  are  possible  : 

**(b) 

i)  to  state  (l(,,x;a-l)  ,  b  e  B  ,  with  probability  - - -  , 

ii)  to  state  (0j,x;a-l)  ,  I  €  Ci(x)  ,  with  probability  — , 

iii)  and  to  state  (x;a-l)  with  probability  — - ,  where 

X(*,a)  =  ^  b  ^(bi)  »  l»00  =  I<€Cl(x)  ^  v  is  constant 

greater  than  or  equal  to  the  sum  of  the  transition  rates. 

iv)  Reward  structure 

1  if  ixi  a  k  and  a  =  0 

r(x;a)  = 

0  otherwise 

It  is  easy  to  see  that  the  objective  function  of  (Iln,k)  represents  the 
probability  P(  %(n;x)  *  k  )  ,  which  is  to  be  aaxiaized. 

Take  n  *  1,  and  fix  k  ,  0  *  k  *  N  .  Let  vn(x;n)  denote  the  value  of 
a  policy  n  in  nnk  and  let  v(x;n)  denote  the  value  of  an  optimal  policy. 
Then  v(.;.)  is  the  unique  solution  to  the  following  system  of  functional 
equations; 

v(x;a*l)  =  max  ,  I  f  r(x)  +  (v  -  X(x,a)  -  n(x)]v(x;a)  + 
asA(x)  v  1 

+  ^(b)  v(1t(b)  *;■> +  Vlv(0lx;,,)  ]  (2) 


where  a  =  0,1,..., n-1  . 


■?J  i 


X 


In  the  next  section  we  establish  that  the  values  of  the  FR-MRC  policy 
satisfy  (2)  and  thus  it  is  stochastically  optimal  with  respect  to  the  number  of 
functioning  components  in  the  system  at  any  time  instant  t  . 

To  show  that  the  FR-MRC  policy  minimises  (maximizes)  stochasticaly  the 
time  the  system  spends  in  nonfunctioning  (functioning)  states  we  first  need  to 
define  the  random  variables  Yjf(x)  ,  Z^x)  ,  where  Yff(x)  (respectively 
Zff(x))  denotes  the  first  passage  time  from  a  state  x  e  So  to  the  set  of 
functioning  states  Si  (respectively  from  a  state  x  €  Si  to  the  set  of  failed 
states  So  )  under  a  policy  it  .  Related  to  these  two  random  variables  are 
the  following  two  families  of  Markov  decision  processes: 

The  faaily  (nD)  ,  n  *  1  ,  that  corresponds  to  Yn(x)  ,  is  defined  by: 

1.  State  space  :  The  set  {  (xjm)  :  x  e  S  ,  m  -  0|  1»...»  n  ). 

2.  Action  sets  :  The  sets  A(x;m)  =  A(x). 

3.  System  dynamics  :  (I)  When  the  system  is  in  state  (x;m)  ,  x  e  S0 

and  action  a  =  (B,C,<f>)  e  A(x)  is  chosen  ,  the  following  transitions  are 
possible  : 

^(b) 

i)  To  state  (ljj.xja-l)  ,  b  €  B  ,  with  probability  - - - 

ii)  To  state  (Of,x;*-l)  ,  I  e  Ci(x)  ,  with  probability  — £- 

iii)  And  to  state  (x;a-l)  with  probability  - - ,  where 

\(x,a)  =  b  k^(bi)  ,  i»(x)  =  IieCl^xj  Hi  “d  v  is  any  constant 

greater  than  or  equal  to  the  sum  of  the  transition  rates. 

(II)  When  the  system  is  in  state  (x;m)  ,  x  e  Si  and  action  a  e  A(x)  is 
chosen,  then  the  next  state  is  (x;m-l)  with  probability  1. 

iv)  Reward  structure 
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r(x;«)  =  [ 

l  0 


if  x  €  Si  and  ■  =  0 
otherwise 

The  family  (IIn)  ,  n  *  1  ,  that  corresponds  to  Zw(x)  ,  is  defined  by: 

The  same  state  and  action  sets  as  in  (IIn)  and  a  transition  law  described  as 
that  of  (nn)  »  but  with  the  places  of  So  and  Si  reversed.  Similarly(  the 
cost  in  (1^)  is  defined  as  in  (IIn)  ,  but  with  So  in  the  place  of  Si  .  The 
objective  function  is  to  be  maximized  in  (fln)  and  to  be  minimized  in  (f£)  . 

Let  Yfld(x)  [  respectively  Z^^(x)  ]  represent  the  number  of  transitions  to 
absorbtion  from  an  initial  state  (x;n)  in  (Iln)  [  respectively  (Hi)  ]  .  It  is 
easy  to  see  that  the  objective  function  in  (IIn)  [  respectively  (Hi)  ] 
represents  the  P(  Y^d  *  n  )  [  respectively  P(  Z^d  <  n  )  ].  To  establish  the 

stochastic  optimality  of  rrQ  for  the  first  passage  problem  ,  i.e.  that  v  n, 

P(  Ynd  <  n  )  i  P(  Ynd  s  n  )  [  respectively  P(  n  )  <  P(  <  n  )  ]  , 

it  is  necessary  and  sufficient  to  establish  the  optimality  of  it0  in  (IIn)  and 


(Hi)  [see  Katehakia-Melolidakis  (1987)]. 

hh— Hr,  The  approach  to  stochastic  optimality  using  unifonnization  and 
Markovian  Decision  Theory  is  applicable  in  more  general  situations. 


3.  npHiality  properties  of  the  PR-liRC  policy. 

We  first  proceed  to  show  that, 

Theorem  1.  The  FR-MRC  policy  stochastically  maximizes  the  number  of 
functioning  components  in  the  system  at  any  time  instant  t  . 

Proof.  The  proof  is  by  establishing  the  optimality  of  ir0  in  the  following 
recursive  equations  . 


v(x;m+l)  =  max  v  I  [  r(x)  +  [v  -  X(x,a)  -  n(x)]v(x;«)  + 
aeA(x)  v  l 

+  ^beB  Mb)  v<Mb)  *■>  +  *1=1  Vlv(0lx;-)  ] 

(3)»fl 
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f  1  if  ixi  *  k  and  a  =  0 

r(x;a)  = 

l  0  otherwise 
So,  we  will  show  that: 

v(x;a  +  1)  =  I  f  r(x)  +  [v  -  X(x)  -  (i(x)]v(x;m)  + 
v  1 

+  1  q!l)xqv(1aq(*)‘x;B)  +  J|=l  Vi''*0!*5**  ] 


r(x;a)  = 


1  if  ixl  *  k  and  a  =  0 

0  otherwise 


<4)»*1 


The  proof  is  by  induction  on  a  . 

For  a  =  0  there  are  four  cases. 

Case  1:  il^.xi  k  for  i  e  C0(x).  Then,  whatever  the  action  a  , 

v(x;l)  is  independent  of  a  .  Hence,  (4)i  holds  trivially. 

Case  2:  >li,xl  =  k  for  i  e  C0(x).  Then,  certainly  r0  aaxiaizes  (3)i 
among  all  possible  policies  f  . 

Case  3:  »li,xi  =  k  +  1  for  i  €  C0(x).  Then,  v(x;l)  is  independent  of  the 
particular  policy  employed. 

Case  4:  Ui.xi  k  +  1  for  i  e  C0(x).  Then,  again  any  action  will  guarantee  a 
constant  cost. 

So,  (4)j  is  true.  Now  assume  (4)a  is  true  up  to  a  included.  To  show  that 

it  is  true  for  a  +  1  also,  we  need  to  establish  the  following  leaaas. 

IriangJU  For  j  *  i,  i,j  €  C0(x),  the  following  hold  : 


a) 

v(lj,x;n)  »  v(li,x;a) 

(5). 

b) 

vC1aq(lj,x) • h  v(laq(li,x)»li,*»a) 

(6). 

c) 

v(x;a)  *  v(lj,x;a) 

(7), 

d) 

v(laq(x).*5»)  *  »(laq(lj,x).lj.*;») 

(8)a 
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Proof.  The  proof  is  by  induction. 

For  ■  =  0  (5), (6), (7)  and  (8)  are  certainly  true. 

Assume  they  are  true  up  to  a  -  1  included.  We  show  that  they  are  also 
true  for  a  .  The  proof  involves  the  following  steps: 

a)  (  (4)B  and  (5)a-i  and  (6)*-!  and  )  inplies  (5)„ 

b)  C  (5)B  )  implies  (6)B 

c)  (  (4)B  and  (5)*-!  and  (7)a-i  and  (8)a-l  )  implies  (7)B 

d)  (  (5)b  and  (7)B  )  implies  (8)B 

More  precisely: 

a)  (SJa-i  implies  that  for  i,j  c  C0(x),  j  *  i, 

fv  -  X(lj,x)  -  Pi  -  p(x)](v(lj,x;»-l)  -  v(li,x;i»-l)]  *  0  -=> 

[v  -  X(lj,x)  -  p(x)][v(lj,x;m-l)  -  v(li,x;a-l)]  * 

*  Pitv(lj,x;m-1)  -  v(x;m~l)]  -  Pi[v(li,x;m-1)  -  v(x;m-l)]  (9) 

Since  pj  *  pj  ,  (7)*-!  and  (9)  imply  that: 

[v  -  X(lj,x)  -  p(x)][v(lj,x;m-l)  -  v(li,x;m-l)]  * 

a  Pj[v(lj,x;m-1)  -  v(x;m-l)]  -  pi[v(li,x;a-l)  -  v(x;m~l)] 

which  in  turn, after  observing  that  lx*  =  *yi  ™>  H(x)  =  R(y)  —>  X(x)  =  X(y), 
leads  to  : 

[v  -  X(lj,x)  -  pj  -  p(x)]v(lj,x;»-l)  +  pjv(x;m-l)]  * 

a  [v  -  X(li,x)  -  Pi  -  p(x)]v(li,x;a-l)  +  piv(x;m-l)]  (10) 
Also  implies  that  : 

^qv(laq(lj,x)»lj»x»*“l)  a  ^qv(1aq(li,x)»1i»*;*"1)  UD 
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and  (5)*-!  implies  that  : 

Il€Co(x)‘tlv(0<*1j*x;--1)  *  Jl€Co(x)V(0«‘1i*X;,""1)  (12) 

By  adding  (10),  (11)  and  (12)  and  using  (4)n  we  conclude  that  (5)n  holds. 

b)  To  show  that  (6)m  is  true,  we  have  to  consider  cases. 

Case  1:  aq(lj,x)  ■*:  j,  i.e.,  there  are  at  least  q  non-functioning  compo¬ 
nents  before  the  jth  one.  Then,  j  <  i  “>  aq(lj,x)  =  aq(lj,x)  and  (6)m 
follows  from  (5)B  . 

Case  2:  aq(lj,x)  *  j,  i.e.,  there  are  less  than  q  non-functioning  compo¬ 
nents  before  the  jth  one.  Then  there  are  two  subcases. 

Subcase  2a:  j  *  aq(lj,x)  *  i  .  The  position  then  counts  for  li,x 

and  hence  aq(li,x)  *  j.  Therefore,  repeated  use  of  (5)a  tfives  : 

v(laq(lj,x).lj.*;»)  *  v(laq(lj,x).laq(li,x),x;a)  *  v(lit laqdi.x) ,x;m) 
which  establishes  (6)n  . 

Subcase  2b:  j  *  i  *  aq(lj,x)  .  Then  aq(lj,x)  =  aq(lj,x)  and  the  result 

follows  from  (5)B  again. 

Hence  (6)n  has  been  established. 

c)  To  show  (7)b  we  first  observe  that  (7)^1  implies  that  : 

[v  -  X(x)  -  n(x)]v(x;»-l)  * 

*  [v  -  X(x)  -  Hj  -  n(x)]v(lj,x;m-l)  +  Hjv(x;m-1)]  (13) 

and  that, 

lt€ CoU)11*^0***’'*-1)  -  Il€Co(x)|i|V(0<’1j’X;*'1)  (14) 

We  next  consider  two  cases  . 
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Case  1:  R(x)  =  R(lj,x),  i.e. ,  in  both  x  and  lj,x  there  are  more  non¬ 
functioning  components  than  available  repairmen. 

Then,  (8)b_i  leads  to  : 

H(x)  #  R(1 j,x) 

Iq=j  ^qv(laq(*) *  Xq_2  *qv(laq(lj, x) * lj»x»*“l)  (15) 

Adding  together  (13),  (14),  and  (15)  and  using  (4)H  we  get  : 
v(x;m)  <  v(lj,x;m)  ,  which  establishes  (7)B  for  this  case. 

Case  2:  R(x)  =  R(lj,x)  +  1,  i.e.,  in  lj,x  there  are  more  repairmen  avai¬ 

lable  than  failed  components. 

Again  (7)^-1  and  (8)a-i  lead  to  : 

R( 1  *  x) 

[v  -  X(x)  -  -  p(x)]v(x;m-l)  +  Xq=1J’  Xqv(laq(x) ,x;m-l)  + 

+  I<€Co(x)‘1Iv(0<*x;,b-1)  * 

jj/  1  .  <j£  \ 

*  [v  -  X(x)  -  (Ij  -  n(x)]v(lj,x;m-l)  +  Iq=1J’  Xqv(laq(ij,x),lj,x;m-1)+ 

+  Il€Co(x)ll*V(0<,1j*X;lr"1)  (16) 

Since,  in  this  case,  X(x)  =  X(lj,x)  +  XR(x)  ,  (16)  may  be  rewritten  as  : 

,  R(lj,x) 

[v  -  X(x)  -  p(x)]v(x;m-l)  +  Iq=1J  Xqv(laq(x) ,x;m-l)  +  XR(x)v(lj,x;m-l) 

+  IJ€Co(x)lV(0*‘x;“-1)  * 

R C  X  *  x) 

*  [v  -  X(lj,x)  -  H j  -  n(x)]v(lj,x;m-l)  +  Xq_1J‘  Xqv(laq(ij>x),lj,x;m-1) 

+  Ii€co(x)lliv{0,,1j,x;*“1)  +  Jijv(x;*-1)  (17) 

Now,  since  for  this  case  R  *  C0(x)  ,  8h(x)(x)  is  the  largest  in  order 

component  in  C0(x).  Hence,  j  <  aR(x)(x)  which,  using  (5)^1  .implies  that 
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xR(x)vdaH(x)(*), *;■"!)  -  xR(x)v(lj«x;»-l) 

But  then,  using  (18)  in  (17)  to  strengthen  the  inequality  and  using  (4)a  , 
we  conclude  that  (7)a  holds  for  this  case  also. 

d)  To  show  (8)a  we  distinguish  two  cases  again. 

Case  1:  aq(lj,x)  j.  Then  aq(lj,x)  =  aq(x)  and  (8)a  follows  froa  (7)a 

Case  2:  aq(lj,x)  *  j  .  Then  aq(lj,x)  is  the  next  to  the  aq(x)  failed 

component,  which  iaplies  that  aq(x)  *  j.  There  are  two  subcases  now: 

Subcase  2a:  aq(x)  =  j.  Then,  (8)a  follows  froa  (7)a  . 

Subcase  2b:  aq(x)  j.  Then,  using  (5)a  and  (7)a  we  get: 

v(laq(x).*5“)  «  v(laq(x)  »laq(lj,x)  »*;■)  *  vdj,  laq(lj.x)  .*!■) 
which  establishes  (8)a  . 

This  finishes  the  proof  of  Leana  1.  □ 

2.  Aaong  all  possible  actions  that  use  the  first  R(x)  repairaen,  the 
action  deterained  by  is  the  best  in  the  optiaization  of  (3)*+^  . 

Proof.  It  is  sufficient  to  show  that  whenever  r  *  s  (  r,s  representing 
the  order  of  repairaen)  and  j  <  i  (  j,i  representing  the  order  of  coapo- 
nents)  then,  it  is  better  to  assign  j  to  r  and  i  to  s  than  vise  versa. 
The  conclusion  will  then  follow  after  a  finite  nuzaber  of  perautations  of  re- 
pairaen. 

Thus,  it  suffices  to  show  that  if  A  u  {r}  u  {s}  is  the  set  of  the  R(x) 
first  repairaen  ,  r  *  s  ,  and  if  j  *  i  then,  for  any  assignaent  t  using 
all  of  thea,  we  have: 
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[v-Xr-\s-I<j€AXq-ti(x)]v(x;»)  +  Xrv(lj,x;m)  +  Xav(li,x;m)  +  iq€Axqv(l^-l(q)  ,x;m) 
+  I«C.(x)V(0»’xl,)  ‘ 

(v-Xr-Xa-I^Xq-tiCxJlvCxja)  +  Xrv(li,x;m)  +  Xav(lj,x;m)  +  IqcAXqv(l^-l(q)  ,*;■) 

*■  IleC<l(*)>*.v(0*'x;,)  <13) 

But, since  Xr  *  Xs  ,  (19)  is  equivalent  to  v(lj,x;m)  *  v(li,x;m)  ,  which  is 
true  by  Lemma  1(a).  □ 

Now  assume  that  at  state  x  repairmen  get  assignments  sequentially.  Then, 

Lcwa  3.  In  the  optimization  problem  (3)*+i  ,  at  each  state  x  we  should 
assign  repairmen  according  to  their  rates,  i.e.,  first  assign  the  fastest, 
then  the  next  to  the  fastest,  e.t.c. 

Proof.  Assuae  we  have  already  assigned  a  set  of  A  repairmen,  A  c  R  with 
I A I  *  R(x).  Then  we  want  to  show  that  if  r*s  ,  r,s  €  R  \  A  ,  then: 

[v  -  Xr  -  -  |i(x)]v(x;m)  +  Xrv(li,x;m)  +  Z<j€AXqv(l^_i(q),x;m)  + 

*  J.€C.(x)lll,<0*-*i*)  * 

[V  -  Xs  -  Iq^Xq  -  H(x)]v(x;m)  +  Xav(li,x;m)  +  Iq€Axqv(l^-l(q) ,x;m)  + 

*  Ilcc.(x)l‘«v(0»-*i*)  (20) 

where  i  is  the  failed  component  to  which  we  decide  to  assign  the  next  re¬ 
pairman  and  f  is  any  policy. 

Now,  since  Xa  *  Xr  ,  (20)  is  equivalent  to:  v(x;a)  »  v(li,x;m)  which 

is  true  (  Leasa  1(c)  ).  □ 
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Lemma  4.  Id  the  optimization  problem  (3)^1  ,  at  state  x  we  should  assign 
no  less  than  R(x)  repairmen  to  failed  components. 

Proof.  The  proof  is  by  induction  on  R(x)  .  Assume  that,  according  to  some 
policy,  we  have  assigned  A  repairmen,  with  IAI  *  R(x)  .  We  show  that  it  is 
then  better  to  assign  one  more.  Take  r  €  R  \  A  .  We  want  to  show  that, 

[v  -  Ar  -  “  n(x)]v(x;m)  +  Arv(li,x;m)  +  Zq€AAqv(l^_i(q)  ,x;m)  + 

+  Il€Co(x)lllv(0^x;B)  * 

*  tv  "  "  *<*>)*<*;■>  +  Eq£AV(Vl(q)‘xiB)  +  lteC9(xftv(0*'XiM) 

(21) 

where  i  is  any  failed  component  that  does  not  get  assigned  a  repairman  from 
A.  But  (21)  is  equivalent  to  v(x;m)  *  v(li,x;m)  which  is  true  (Lemsa  1(c)). □ 

Lanas  (3),  (4)  and  (5)  are  enough  to  complete  the  induction  step  in  the 
proof  of  Theorem  1.  Indeed,  in  the  optimization  of  (3)»*i  at  state  x  we 
should  use  the  first  R(x)  repairmen  (lemmas  3  and  4  combined)  and  among  all 
policies  that  use  these  first  R(x)  ,  ir0  i*  the  best  (lemma  2).  Hence,  the 
inductive  step  is  complete  and  Theorem  1  has  been  proved.  □ 

OnmlhrY  1.  The  PR-MRC  policy  maximizes  both  the  total  expected 

discounted  operation  time  of  the  system  and  the  availability  of  the  system. 

Proof.  Notice  that  since  the  total  discounted  operation  time  of  the  system  is 

given  by  e~^t  P(Nn(t;x)  *  K)  dt  and  since  the  average  operation  time  of 

the  system  is  given  by  lim  =  /J  P(Nff(t;x)  *  K)  dt,  the  stochastic  optimality 

* 

of  nQ  implies  its  optimality  with  respect  to  the  other  two  criteria. 

Theorem  2.  The  FH-lfRC  policy  stochastically  minimizes  the  time  the  system 
spends  in  non-functioning  states  until  it  starts  operating  again.  Moreover, 
no  stochastically  maximizes  the  operation  time  of  the  system  untill  failure. 


Proof.  According  to  the  discussion  in  section  2  ,  it  is  sufficient  to  prove 

the  optimality  of  Hq  for  the  two  families  (fln)  and  (Hi)  .  Now,  it  is  very 
easy  to  check  that  all  the  arguments  in  the  proof  of  Theorem  1  go  through 
for  the  (nn)  problem  also,  establishing  thus  the  optimality  of  tIq  .  The  same 
arguments  work  for  (!!£)  also,  but  with  the  sign  of  all  numbered  inequalities 
reversed.  0 
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